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I,'* INTRODUCTION 



BACKGROUND 



In many states, the genesis lor a state sponsored’ nss/hu- 1 
ment program has resulted from the requirements 5or such 
studies for participants in the Elementary and • Secondary 
Education Act. 

• r 

In Connecticut, the State Board of.. Education was encouraged 
additionally £>y discussion and action of the Connecticut' 

General Assembly that Indicated a desire to evaluate the. ade- 
quacy of educational programs in the public schools/' -Furf her , 
there was professional recognition in’that new evaluation pro- 
cedures could predict the degree of mastery of specific skills 
or outcomes, by a particular, age population.' Such data have 
important implications for curriculum revision, teacher » 
education, and numerous management decisions.'.’ 

; ‘ - 

Accordingly, iri July of 1971, the* State Board of Educa- 
tion contracted with the. Institute fbr the Study of Inquiring 
Systems for the first year of Connecticut's first state- 
sponsored educational needs study.- ^The initial needs- assess- 
ment was to be in. the area of reading; 'selected because of the 
high priority given by the Connecticut State Board of. Education 
to "Readirig for the Seventies,!' a twelve part project set up 
by the State Board- in November of. 1970. The purpose. of the . 
'heading for t^e Seventies" program was to improve reading 
instruction and teacher training in r reading throughout^ the 
State. The Reading Assessment ..is expected to point the way 
toward improvements in the torching of re-ading in Connecticut 
schools. r . 

\ ^ ' 

The specific purpose of the assessment was to determine 
•the percentage of students of a given age who can perform each . 
of a series of specific reading skills or. tasks. From the 
results feir a given skill or task,, accurate predictions about 
the capabilities of all students in the age group to perform 
likewise will be made for communities with similar -char^cter-^ . 
istics. Further comparisons for each task will be made for the 
State, the northeast, and the entire country. • ' 
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.In order to permit these comparisons, ^.he Connecticut 
Reading Assessment has used available instrumen ts • and appli-'- 
cable procedures developed by National Assessmen t. of 
Educational Progress, adapted where necessary to the particular 
requirements of the, State of Connecticut. 



This assessment program was. financed through various 
provisions of the Federal Elementary and Secondary Education 
Act, and was directed and monitored by an Executive. Group 
composed of staff members of the Connecticut State Department 
of* Education. ’ ■ 



NATIONAL' ASSESSMENT OF EDUCATIONAL' PROGRESS 



The National Assessment of Educational" Progress (NA) is 
the most extensive -assessment project ever initiated in, the 
United States. It originated in 1964 under the auspices' 1 of 
the Committee on Assessing -the Progress of Education, and 
since July of 1969, it has been a project of the Education 
Commission of the States.. The stated goal, of National Assess- 
ment is to make available baseline census-:.like data on the 
, educational attainments of young Americans based on particular 
educational objectives. National Assessment is therefore a 
data gathering project designed to provide specific information 
.about the knowledge, skills, understandings, and attitudes of 
®young. people. The data are collected and reported at specific 
item levels, v/ith each item designed to test .a, specific " 
educational objective.- 




With results reported by item, 'there are no aggregate 
norms, and no results are reported in. overall cognitive areas. 
•The individual exercises are reported along with the percent 
choosing or .producing both cdrrect and incorrect answers for 
each exercise. Attention is directed at particular samples 
of behavior rather than at the summation of ’ behaviors , and 

rtf * 

can therefore provide useful direction in teaching. .or curri- 
culum evaluation, and overall decision making and fund 
allocation.. 
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INSTITUTE FOR THE STUDY OF INQUIRING SYSTEMS. 



The Institute for the Study of Inquiring Systems , (iSlS) 
was chartered in 1967 as a non-profit, tax-exempt organization,, 
specializing in performing educational research for .all levels 
of government.' It has worked with the nnsylvan-ia Department 
of Public Instruction, various school districts, a consortium 
of Pennsylvania, New York, New Jersey, and Delaware, and the 
Office 'of Education of' the Department of Health, Education 
and Welfare. 

.* A 

Throughout- the* planning, development, and administration 
of the Connecticut Reading Assessment, ISIS has worked- very ^ - 
closely with National Assessment in order ..that "the NA materials - 
and procedures adapted for’ use in Connecticut would permit 
accurate, meaningful comparisons of the results. ISIS has 
also worked closely with the Executive Group of the .State . • . 

Department of Education to assure that the assessment adequately 
reflected Connecticut's educational goals and practices. 



Any inquiries concerning the methodology or x analysis used, 
in this assessment should be addressed to Michael H. Halbert, 
Ececutive Director of the Institute. • " 
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II,., PACKAGE DEVELOPMENT 



In National Assessment terras, the assembly of questions, 
tasks, etc., administered to a single student is a. ''package . " 
Many criteria had to be met in devel'oping the v pac,kage.s used 
'to assess the reading skills of Connecticut's 9, 13, and 17 
. .year old students. 

r 

Q 

I 

. READING dBJECT I VES 

Beginning even before contract award in July, 19-71, read- 
, ing specialists- and other educators within the State, Department 
of Education began formulating the goais of reading education • 
and their particular behavioral outcomes. Inasmuch as -■< 

. National Assessment testing is objective oriented, it was 
•essential that each of Connecticut's reading- objectives be ■ 

. matched to those assessment exer'cisus which would truly test 
Connecticut objectives. Since National Assessment's statement 
of their reading objectives was much lengthier and in much 
greater detail, than Connecticut's, this matching was fairly ■ • 

*' tedious. .. Although a great deal of overlap had been anticipated, 
the matching was found to be totally ‘unique in that any single • 
statement Of one goal set corresponded ’ to only one statement or 
set ,0‘f statements in the other goal set. Table 1 shows the' 
National^ Assessment reading objectives in partial detaif /ana 
-the corresponding Connecticut goal statements.. " • 



DESIGN OF ASSESSMENT -PACKAGE * ' 

D ’ ' 

' * ‘ \a 

Test Booklet - In November pf 1971, National Assessment released 
to ISIS approximately 220 of the reading exercises which .were 
planned to be (officially disclosed to the public in May or Ju^c 
of 19 7 2[. At that time ISIS and the Executive Grot/p had agreed 
that in the interests- of maximum comparability, -.it was desirable 
that Connecticut's assessment instruments and procedures be as 
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much like National Assessments as possible.'. With this' in mind, 
ISIS'began the task of designing ''the assessment package to 

meet the following criteria: - • 

> • , ' 

j? ' ■ ' , ■ ’ 

• ^ • . , 

• National' Assessment exercises would be used 
’ p ’ without-; change in content or the time allotted 
for answering each item. 






o The total administration time for any package 
• , would be fifty minutes or less - in -keeping with 
both National Assessment procedures and. normal •' 
' school period length. 



«■ To the extent pos'sibXe , items -would be selected 
.to represent all of Connecticut's reading goals. . 
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• 'Items of varying difficulty level would be 
ihcluded in the same proportion as th'e,v appeared 

_ ’ .. in ' National Assessment's release. \ 

, p . ° 

■r r . . 

• The number of questions per- package would be 

' kept in the 19 - 22 range. 1 ■ . 

i * » 

* % 

• Only those exercises suitable for group admini- 
stration would be used. 

• • • , • '* 

- The assessment instruments -were developed separately for 
each age. group! The following steps in the development were 
cjommon for all age^ groups . The- first step was- to list^all 
the NA released items,- indicating 1) the, Connecticut objective, 
2) the administration time allotted, 3)”* the-NA ascribed 
difficulty level, and ,4) the item numbers of other NA items : 
which used the same text with different question's (since we 
would not use two exercises .with the same text 'in, one package) . 



The first inforntetion learned from this listinq was that 

w 



all of Connecticut * spreading goals were not equally represented 
in the NA release and that, not unexpectedly, none of the 
released items tested the goal "Each child develops an interest 
in, and enjoys reading.". (Goal 1.4) Of the four remaining, 
goals, goals No. 1.3 and 1 ?5 appeared relatively rarely, and 
goals 1.1 and. 1.2 quite' frequently. (See: Table 1 for goal" 
definitions.) ’ .... 

. • • . i - 
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Accordingly, all re 
'1.3 and 1.5 were, se 
only from those rel 
A random selection 
35 njinufes of admin 
approximately 15 mi 
for instructions) . 
items selected were 
each level appeared 
interchanged as req 
the 'same while corr 
difficulty level, 
were approximately 
summarizes the desi 
* 



leased multiple choice items testing goals 
lected for use, leaving a choice to be made 
eased items representing goals l.,l, and 1.2,.' 
of these were made that yielded approximately 
istration time (it had been estimated that 
nutes of administration time v:ere necessary 
The estimated difficulty levels of all the 
then compared with the proportions at which 
in the total NA release. Items we're 
uired to keep the overall time approximately 
ecting the proportional distribution of the 
Lastly, items were rearranged so that there 
twenty items in each package. Table 2 



gn of the packages. 






V. 



Instruction Tape - In order to minimize, the effects on' student 
performance of individual administrators, all package admini- 
strations were By tape-recOrded instructions after an initial 
verbal introduction by the administrator. This assured commo- 
nality of instruction and time between i,tems for all administra- 
tions conducted, in the State and was in' keeping with NA pro- 
cedures . Figure 1 is 1 the script provided to each administra- , 
tro for her/his. opening introduction, and Figure 2 is the script 
•of the taped instruction heard by all students. Subsequent , to 
the initial instruction, the content of the tape varied accord-' 

■ ing to the time allotted for completion of each test item, and 
whether or not £ny additional instructions were required. 






Pre-test Fc rly in January of 1972, ISIS ...staff members visited 
'.Connecticut for the dual. purpose of hiring a field, staff and .•> 
conducting a pre-test of the administration procedures. Some^ 
pre- tests' were conducted jointly and some individually by both 
the ISIS ’staff} -members and the, then just-hired Field Supervisor, 
at a total of six schools (two-at each age level) which were 
not to be in the final sample, and whose cooperation had been ’ 
assured through earlier efforts of State Board of Education y 
personnel. JThf purpose of the.'pre-te'st was two-fold: 1) to 
assure the adequacy of the instructions, oral, and taped, in 
terms of student ^comprehension, and 2) to provide' the back- 
ground necessary to prepare training instructions for the admini 
strators. ^As. a' result of . the' pre-test, many changes' and improve 
ments were made* in~the administrative procedures 'which' were 
eventually used during the assessment in March. • 0 
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TABLE- 1 

NATIONAL ASSESSMENT READING OBJECTIVES 

*1. COMPREHEND WHAT IS READ 

* A. Read > individual words 

A 

l 

\ • . 

*' 1. Decode printed words. 

* 2. Comprehend the meanings of words.* 

* B . Read phrases, clauses, and sentences : 

* 1. Recognize patterns af words. t \ 

* 2. Comprehend the meanings of phrases, 

clauses, and sentences. 



CONNECTICUT READING OBJECTIVES 

1.1 Each student reads, and understands 

\ 

j material appropriate for his age 
! and experience. 



* *- 3. 

* C. 


‘ Interpret non-literal and figurative 
language. . 4 

Read paragraphs, passages, and longer 


1.2 Each student reads and analyzes 

material appropriate to his age 
■ - / 

and experience. 




words. 


... 


* 1 . 


Find the main point and supportings 
details in a paragraph. 


f 


* ■ 2. 


Comprehend the meanings of the main types 
of paragraphs in fiction and non-fiction. 


. . *■ 


*. ’ 3. 


Comprehend the general import of 
paragraphs, passages, and longer words. 


‘ 



1.1 Each student reads and understands 
material appropriate for his age 
and experience. 



*11. ANALYZE WHAT IS READ. 

i 

f j 

. r 

* A. Be able to trace sequences . 

1. ‘ : Retell a story with the events in 

proper order. 

2. Follow the development of an author's 
idea. 

* 3. See the steps in a process. 



^Indicates those objectives tested by exercises used in Connecticut Pleading Assessment 
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TABLE 1 (cont'd) 



NATIONAL, ASSESSMENT READING OBJECTIVES 

* B * Perceive the structure and organization 
of the work'. 



1 
2 , 



Grasp the overall design 



Recognize large thought divisions 
.within the work . 



CONNECTICUT READING OBJECTIVES. 

1.2 Each student reads and analyzes 
material appropriate to his age 
and expedience. " » 

i 1 



See the devices used to provide 
transitions between the various parts j 
of a work or to connect -the various 
parts . 



* c * See the techniques by which the -author has 
f created his effects. 



1 . 



2 . 



Understand the u author 1 s manner of using 
language to 'convey and interpret infor- 
mation and emotional colorations. 

* \ K 

K* ' 

Perceive as exactly as possible the nature 
and purpose of the author * s* tone or mood. 



•* ^ ' 

3. . Discern the dynamics o£ literary ' style. 



. I 



"*ni. USE WHAT, IS READ. 



*’ A * RemembedN^ignificant parts of what is read . 



1- Remember (the main idea in a piece of 
. exposition a*nd the theme or dominant • 
impression of a descriptive or narrative 
passage. 

* 2. Remember pertinent detai 1 s . 

3. Remember the patterns into which 
the details fit . 

** Follow wr itten’dir ections . 



1. 



Connect what is read with things in the 
world. 



1.1 Each student reads and understands, 
material appropriate for his age te 
and experience. {§ 



Follow directions correctly. 



-8- 



r 



m 



<) 



J 



J 



( 



TABLE 1 (cont'd) . 

NATIONAL ASSESSMENT READING OBJECTIVES CONNECTICUT READING OBJECTIVES. 



* C, Obtain information efficiently . 

* 1. Skim a paragraph or passage. 

* 2, Use the various parts of a book as aids 

in finding what is needed. 

* 3. ,Find information efficiently in a 

variety of reference tools. 

* 4. Obtain information from Vnon— textual" 

sources. * 



1.5 Each student locates, and uses 

printed information essential for 
the decisions he has to make. 



O' 



*I.V. REASON LOGICALLY FROM WHAT IS READ. 

* A. 4 Draw appropriate inferences ,irom material 
that is read and ’’read between the lines'* 



1.2 Each student reads and. analyzes 
material appropriate to his age- 
and experience. 



where necessary . * 

1. Anticipate outcomes. 

2. Infer causes from a perusal of the 
effects. 

3. Supply missing -elements (such as yords , . 
ideas., or steps) in a' passage that is not 
as well written as possible. 

B. Arrive at a general principle after examining 

a series of details . . x 1 

' 1. Select instances, or examples that are 
, relevant to the ijiain point. 

2. Determine' what general principle is 
illustrated by a set of examples. 

3. Explain exceptions to the general principle. 

C. Reason from a general principle to specific * 
instances . , 

o ■' 

1. Find out what the general principle is. 
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